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ABSTRACT 

Multiple  neuro-fuzzy  inference  systems  using  hybrid  learning  algorithm  as  an  adaptation 
mechanism  have  been  focused  here  for  navigation  of  autonomous  underwater  vehicle  (AUV).The 
underwatervehiclecanbeexhibitedassix-dimensionalnonlinearandcoupled  equations  of  motion 
associated  with  variations  of  hydro  dynamic  coefficients  which  are  difficult  to  model  in  a  realistic 
manner.  Without  earlier  acquaintance,  the  feed-forward  neuro-fuzzy  controller  can  be  directed  to 
obtain  the  unknown  parameters  of  the  model  which  may  aid  motion  planning  strategy  of 
underwaterrobotbyoverlookingthenonlineareffectsoftheAUVdynamics.By  amending  fuzzy 
membership  function  of  neural  networks,  the  benefits  of  fuzzy  logic  and  neural  network  can  be 
mingled,  such  as  capability  of  FIS  to  deal  with  uncertainty,  employing  human  perception  and 
comprehensive  approximation  as  well  as  adapting  competence  of  neural  networks.  ANFIS  has  been 
trained  with  the  hybrid-learning  mechanism  which  employs  back-propagation-based  gradient  descent 
approach  and  least  squares  estimate  (LSE)to  estimate  parameters  of  the  model.  This  approach 
instigates  faster  decision-  making,  obstacle  avoidance  and  also  tracking  targets.  The  simulated 
analysis  may  authenticate  that  the  heuristic  navigational  approach  is  able  to  negotiate  with  chaotic 
environment  during  navigation  of  under-water  robot. 

Keywords:  ANFIS,  Hybrid  learning,  Optimal  path,  Obstacle  avoidance,  Steering  angle,  Target 
seeking  behavior. 


1.  INTRODUCTION 

Recently,  several  control  mechanisms 
for  AUV  have  fetched  remarkable  research 
interests.  Autonomous  Underwater  Vehicle 
sare  generally  utilized  for  hazardous 
underwater  tasks,  such  as,  exploration  and 
surveys  of  potentially  dangerous  wrecks, 
rescue  operation,  surveillance,  inspection, 
recovery,  maintenance  etc.[l].UVs  may  be 
steer  able  in  three  directions  and  can  be 
automated  to  float  reflexively  or  to 
dynamically  ramble  near  a  preferred  location 
or  to  move  at  different  depths  under  water[2]. 
Due  to  the  difficulty  in  interaction 
between  the  nonlinear  dynamic  model  of  AUV 
and  the  environment,  motion  planning  for 
AUV  in  an  ambiguous  and  cluttered 
environment  leads  to  demanding  control 
problem[3].Modern  control  may  provide 
superior  execution  by  adapting  the  ambiguities 


of  hydrodynamics  as  well  as  revealing 
resistance  to  in  stabilities.  Foremost  intent  is  to 
organize  an  order  of  appropriate  paths  based 
on  updated  parameters  through  online  learning 
method,  which  enables  the  vehicle  to  fulfill  its 
mission  by  showing  obstacle  avoidance  and 
target  seeking  behavior  in  a  combined 
manner  [4].  The  flexibility  of  the  fuzzy 
inference  system  can  be  accomplished  by 
either  rule  base  amendment  and/or 
membership  functions  reformations  through 
learning  mechanism  of  neural  networks  [5]. 
Due  to  the  multifaceted  profile  of  AUV, 
motion  control  is  further  challenging  to  solve 
as  any  rotation  all  motion  around  any  axis  may 
initiate  hydrodynamic  translational  forces  and 
rotating  moments  [10]. 

Neuro-fuzzy  systems  furnish  the 
combination  of  fuzzy  reasoning  based  on 
human  perception  which  uses  logical 
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operators  to  combine  degrees  of  truth  on  a 
numeric  scale  even  under  uncertainty,  and 
neural  networks  which  can  leam  fast  without 
rational  model  of  the  system[8].  The  simple 
fuzzy  reactive  approach  in  navigation  problem 
intermittently  endures  two  major  problems, 
such  as  being  stuck  in  local  minima  and  raise 
in  number  of  rules  to  cope  up  with  different 
possible  positions  of  obstacles  and  targets 
[11]. The  proposed  approach  has  the  benefit  of 
reduced  processing  time  [7]  by  introducing 
weighting  factors  for  activating  optimum 
number  of  if-then  rules  based  on  sensor  inputs 
in  crisp  values. 

The  fundamental  task  of  the  proposed 
controller  is  to  make  the  vehicle  to  follow  a 
predefined  trajectory  to  reach  the  final 
destination  [9].  AUVs  tender  many  advantages 
for  performing  difficult  tasks  submerged  in 
water  without  human  intervention  in  a  less 
expensive  way.  This  paper  has  beendivided 
into  different  sections  which  can  be 
summarized  as  follows:  Section  2  describes  the 
dynamic  model  of  underwater  robot  for  motion 
planning  analysis.  Section  3  presents  the 
formulation  of  proposed  ANFIS  algorithm. 
Section  4  briefly  designates  online  hybrid 
learning  method  for  ANFIS  method.  Section  5 
exhibits  simulated  study  in  MATLAB  scenario 
which  contains  a  number  of  obstacles  scattered 
in  a  disorderly  fashion.  Section  6summaries 
the  contribution  of  this  paper. 

2.  DYNAMICS  OF  THE  UNDERWATER 
VEHICLE 

The  robot  has  been  modelled  as  a  mass 
which  is  free  to  move  in  the  3D  space.  The 
dynamics  that  have  been  used  are  mainly  based 
on  the  analysis  presented  by  various 
researchers  [3].  The  generalizedequations  (2.1) 
and  (2.2)of  motion  for  AUV,  relative  to  an 
inertial  frame,  can  be  given  by  six  coupled 
non-linear  differential  equations: 

M(v)v+CD(v)v+g(ij)+d=T  (2.1) 

rj=JCn)v  (2.2) 

Where,tj=[xy  z  (j)0\|/]T  is  the  position  and 
orientation  vector  considering  the  earth-fixed 
frame  as  reference. 


Figure  1. Position  and  orientation  of  prototype 
underwater  robot  model. 


v  =  [u  v  w  p  q  r]  denotes  the  velocity  and 
angular  rate  vector  in  body-fixed  frame  as 
shown  in  figure  1,  M  (v)  eR6*6  specifiesthe 
inertia  matrix  (including  added  mass);  C(v)  e 

R6  6  represents  the  matrix  of  Coriol  is, 
centripetal  and  damping  term;  d  signifies  the 
gravitational  forces  and  moments  vector  along 
with  uncertainty  and  X  is  the  input  torque 


vector.  J  (tj  )is  the  transformation  matrix  and 
is  defined  as, 


m= 


J<Jh)  0 


6x6 


0 


6x6 


J(*h ) 


The  position  and  orientation  of  the 
robot  can  be  depicted  relative  to  the  spatial 
frame  and  the  linear  and  angular  velocities  are 
expressed  based  on  the  body-fixed  frame.  The 
standard  notations  of  SNAME  (1950)  have 
been  followed  here  [3].  The  vehicle’s  position 
and  orientation  with  respect  to  the  earth  fixed 
coordinate  system  can  be  represented  by  a 
vector, 

PB=[x  y  z  (j)  0  (//]'=[/?,  b2f 
Velocities  of  the  robot  is  represented  as, 
V  =  [vc  ru]7  and  Forces  and  moments  can  be 

denoted  as  A,  =  [7^ 


where, 


c  y/9 


sif/0 


-s9 


sfi&Ocy/  -cfisy/ 
s  (/>  s  0  s  y/  +  c  (/>  c  y/ 
s<f>c0 


c  (/>  s  9  c  y/  +  s  (/>  s  y/ 
c  (/>  s  9  s  y/  -  s  (/>  c  y/ 
c<j)c9 
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and  ( 1  scf)td  ccf)t0  N 

J  (j 72)  =  0  c4>  —  s0 

v0  s  <p  /  c6  c  <p  /  cO  ; 

Heres-  =  sin(- ),  c-  =cos(-  )andt-  =tan(- ) 

The  centre  of  the  body-fixed  frame  is 
assumed  to  be  located  at  the  centre  of  gravity 
with  neutral  buoyancy  due  to  its  symmetric 
structure.  Only  three  actuators  are  considered 
here  to  guide  the  robot.  Two  thrusters  for 
horizontal  motion  in  forward,  backward  and 
also  for  rotation  about  the  z  axis  and  another 
one  for  linear-  motion  along  z  axis.  Rotations 
about  the  x  and  y  axes  cannot  exist,  so  that 
they  are  not  included  in  the  equations  of  the 
system  that  has  been  finally  used. 


output  gained  through  the  node  function  will 
be  the  input  data  to  the  next  layer  as  indicated 
in  figure4. 

Layer l:The  input  layer  collects  data 
from  arrays  of  sensor  inputs  xl,x2,x3andx4 
which  symbolizes  the  obstacle  distances  and 
target  angles  with  respect  to  current  robot 
position. 

Layer2:  Each  node  of  this  layer 
denotes  a  particular-  fuzzy  membership  function 
whose  parameters  can  be  altered.  Node 
function  stipulates  the  degrees  to  which  the 
inputs  gratify  the  quantifier.  For  four  inputs,  the 
outputs  from  the  nodes  of  layer  2  are  given  as 
follows; 

0Xn=fiM{x)  (3.2) 


3.  FUZZY  INFERENCE  SYSTEM  WITH 
ADAPTIVE  NEURAL  NETWORK  FOR 
NAVIGATION 

To  design  the  architecture  of  ANFIS, 
the  neural  network  has  to  learn  about  the  fuzzy 
inference  system  behavior  and  the  gained 
knowledge  will  be  used  to  adaptively  optimize 
parameters  (antecedent  as  well  as  consequent) 
of  the  network  [1],  Here,  three  ANFIS  models 
of  same  structure  has  been  used  to  find  out  left 
horizontal,  right  horizontal  and  vertical 
thruster’s  speed  figureAl. Finally,  by  using 
difference  method,  final  steering  angle  for 
robot  for  the  current  position  of  robot  with 
respect  to  target  position  has  been  found  out 
from  the  speed  of  thrusters  computed  by 
ANFIS  models. 

The  first  order  Takagi  Sugeno  Fuzzy 
system  has  been  considered,  where  each 
steps(e.g:  fuzzification,  rule  base,  inference 
mechanism  and  defuzzification)  are  treated  as 
neural  network  layers  figureA3.  For  ANFIS 
model,  rules  are  outlined  in  a  generalized 
manner  as  follows  in  equations 
(3.1), (3.2), (3.3), (3.4), (3.5), (3.6)  and  (3.7). 

IF  xl  is  Pi  x2  is  Qj ,  x3  is  R;  x4  is  S;  THEN  fj= 
Pj  xl  +  i-j  x2  +  Sj  x3  +  tj  x4+  Uj(3.1) 

Where  ‘i’  denotes  the  number  of 
membership  functions.  P,Q,R  and  Sare  the 
fuzzy  membership  sets  specified  for  the  input 
variablesxl,x2,x3andx4.For  jth  rule,fj  js  the 
linear  consequent  function  expressed  in  terms 
of  the  inputs  along  with  pj,rj,sjand  tjas  the 
consequent  parameters. 

In  the  ANFIS  structure,  node  sofa 
layer  have  same  activation  functions  [6].  The 


Where,  x  is  the  input  to  the  nth  node  of 
this  layer;  M=  P,Q,R,S  are  the  membership 
functions  for  inputs  xl,  x2,  x3  and  x4 
respectively.  Here  all  membership  functions 
are  considered  as  bell  shaped  function  figure 
A2  which  is  depicted  as  follows; 


Mu.  (*)  =  ■ 


1+ 


f  A2 
x  —  c 


V  an  J 


bn 


(3.3) 


Where  an,  bn  and  cn  are  the  variables 
for  the  fuzzy  membership  function  [2].cn 
signifies  the  centre  of  the  corresponding 
membership  function;  an  is  the  half  width;  and 
bn/2an  restraints  the  slope  at  the  cross  over 
points: 

Asbell-shaped  function  figureA2  can 
modify  its  pattern  with  the  change  in  values  of 
parameters  the  membership  functions  of 
linguistic  label  Mn  may  have  different  forms 
of  representation  as  per  requirement  of  data  set 
of  the  problem. 

Fayer  3:  This  layer  does  not  contain 
any  activation  function.  The  output  of  each 
node  is  the  product  of  all  incoming  values  to 
that  specific  node  which  is  a  circular  one 
(fixed)  symbolized  as  "n" ■ 

°3,m  =  wm  =  A>„  (*)  *  Mq.  (*)  *  Mr.  (*)  *  Ms.  (*) 

(3.4) 

The  outcome  of  each  node  of  this 
layer  embodies  the  firing  strength(degree  of 
fulfilment)  of  the  associated  rule. 
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Layer  4:  As  normalized  firing  strength 
can  be  achieved  as  an  outcome  of  layer  4,  each 
node  is  labelled  as  “N”  (fixed  node).  Number 
of  nodes  of  layer  4  is  same  as  layer  3.  The 
output  can  be  expressedas, 

04,m  =  K  =  (3.5) 

S'  w 

m 

m=  I 

where,  ‘n’  is  the  total  number  of  membership 
functions  used  in  layer  2  for  fuzzification  of  all 
input  signals. 

Layer  5:  Number  of  nodes  for  this 
layer  is  same  as  that  of  the  previous  one.  Here, 
each  node  has  a  linear  adaptive  function.  The 
output  can  be  expressed  as, 

05, m  =  Wffl  fm=  Wm  (  pm  xl+  rm  x2  +  sm  x3+ 

tmx4  +  um  )  (3.6) 

where,  {pm,  rm,  sm,  tm,  um}  is  the  premise 
parameter  set  and  whs  the  normalized  firing 
strength  from  layer  4. 

Layer6:The  single  node  of  this  layer, 
identified  as  “X”,  can  give  the  defuzzified  crisp 
value  for  actual  thruster’s  speed  which  has  been 
computed  here  as  the  summations  of  all  output 
signals  from  layer  five  or  previous  layer. 

n 

S'  w  f 

n  /  ^  m  m 

°W,=X*..  f,n  =N -  (37> 

m=l 

This  whole  procedure  has  been 
repeated  to  determine  Horizontal  and  Vertical 
Thruster’s  speed  along  with  different  sets  of 
parameters  for  antecedent  and  conclusion  parts 
of  ANFIS.  In  order  to  attain  a  preferred  input- 
output  mapping,  these  parameters  have  to  be 
revised  according  to  the  assigned  training 
input/output  data.  After  computing  Thruster’s 
Speed,  Actual  Steering  Angle  can  be 
calculated  by  using  difference  method. 

4.  HYBRID  LEARNING  ALGORITHM 
FOR  ANFIS  MODEL 

Hybrid  learning  scheme  combines 
Back  propagation  based  gradient  descent 
method  and  least  square  estimate  (LSE)  for 
ascertaining  variables  or  parameters  of  a 
network  [8].  As  ANFIS  network  has  only  one 
output  that  can  be  represented  as  a  function  of 
input  variables  and  parameters  it  can  be 
denoted  as  F(I,G)  shown  in  equation  (4.1). 

Where,  I:  Vector  representation  of 
input  variables;  G:A  set  of  parameters  for  both 


antecedent  andconsequent  portions  of  the 
network.  The  parameter  set  G  can  be 
distributed  into  two  sets 

G 1  (antecedent  :an,bnandcn) 
andG2(premise:  {pm,rm,sm,tm,um}) 

Assume  a  function  J  such  that  the 
combined  function  JoF  is  lineal'  in  elements  of 
G2,  subset  of  G.  The  elements  of  G  can  be 
found  by  u  single  act  squares  method  through 
the  following  computation, 

J  (output)  =  J  o  F(I,  G )  (4.1) 

For  given  values  of  Gl,  training  data  D 
can  be  added  to  the  equationand  the  equations 
can  be  gathered  in  matrix  from: 

BZ  =  C  (4.2) 

Z  is  a  matrix  form  of  the  parameter  set 
of  G2  with  dimension  Mxl.  The  dimension  of 
B  is  DxM  and  dimension  of  C  (training  data)  is 
Dxl.As  the  number  of  linear  parameters  (M)  is 
lesser  than  the  number  of  training  data  (D),  the 
exact  solution  cannot  be  evolved.  So,  least 
square  estimate  of  Z,  Z  *  can  be  acquired.  The 
most  recognised  formula  for  Z*  in  equation 
(4.3)  is: 

Z  =(BTB)lBTC  (4.3) 


T  T 

Where.B  is  the  transpose  of  B  and  if  B  Bis 

non-singular  then  (BT B)  '  BT  is  the  pseudo 


inverse  of  B.  When  BiB  issingular,  sequential 
method  of  Least  Square  Estimate  is  the  only 
method  to  get  the  solution  in  equation  (4.5): 

(cf+1-^+1Z,)  (4.4) 

G'b,+^'  =  4.5) 

l  +  bMZi 


Zi+ 1  —  Z;  +  Gi+lbM 


G,+l  =  G,  - 


Where,  b J  :  i-th  row  vector  of  matrix  B ;  cj  : 
the  i-th  element  of  matrix  C.  G(is  the 
covariance  matrix  and  least  square  estimate  Z* 
is  Z  D.  InitiallyXo=0  and  GO  =oI;  where  I  is 
the  identity  matrix  with  dimension  MxM  and  a 
is  a  positive  large  number. 

Within  the  forward  pass  [8],  fuzzified 
version  of  input  data  associated  with  given 
values  of  Gl  has  been  taken  for  calculation  of 
each  node  output  until  B  and  C  given  in 
equations  (4.2)  is  found  and  then  the 
parameters  in  G2  will  be  acquired  by  the 
sequential  least  squares  formula  in  equations 
(4.4).  Then  outputs  from  middle  layers  will  be 
guided  towards  the  final  single  output. 
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In  case  of  backward  pass,  the  error  is 
circulated  from  output  end  to  input  end  and 
parameter  set  of  G1  can  be  revised  through 
gradient  descent  method.  Suppose  the  given 
training  data  seth  as  D  entries,  the  error 

measure  (or  energy  function)  for  the  p1'1 
(l<d<D)  entry  of  training  data  entry  can  be 
stated 

As  the  sum  of  squared  errors  in 
equation(4. 6)  [3,8]:  Ed  =  YSrd~°d?  (46) 

Where,  is  the  desired  output  and  0(j  is  the 
tangible  output.  Then  the  overall  error  measure 
is  in  equation  (4.7): 

E  =  f ]Ed  (4.7) 

d=  1 

Forth  ed1'1  training  data,  according  to 
gradient  descent  method,  the  error  rate  for  the 
output  node  at  layer  L  may  be  estimated  as, 

ftp 

-f-  =  -2(Td  -  Od )  (4.8) 

80 


For  the  internal  node  at(l,m)  layer  1 
index  m,  error  rate  can  be  obtained  by  the  chain 
rule: 


be,  y"  fA 
Bo‘mJ  h  ao“ 

Where,  1  <  1  <  L  -1 


toft 

do' 


(4.9) 


This  rate  of  error  for  an  internal  node 
may  be  depicted  as  a  1  incar  combination  of  the 
rate  of  errorsfor  nodes  of  the  next  layer.  Hence, 


for  all  1  <  1  <  L  and  1  <  m<  n, 


dE„ 


80 


can 


m,d 


be  found  by  using  equations  (4.8)  and  (4.9). 
Suppose  for  given  the  adaptive  network,  p  is  a 
parameter,  the  details  of  equations  are  shown 
in  equations  (4. 10), (4. 1 1  ),(4. 1 2)  and  (4.13). 


then  - 


8E., 


z 


8Ed  80 


80 


(4.10) 


8p 
setofnodes 


whose 


$P  o’er ' 

Where,  Yisthe 
outputdependsonp. 

Then  the  derivative  of  the  overall  measure  E 
with  respect  to  p  is 


dE^d^ 

8B  h  8P 


(4.11) 


Therefore,  the  renew  formula  for  the 
8E 

parameterpis  A P  =  —A -  (4. 12) 

dp 


Where  A,  is  the  learning  or  adaptation  rate 
which  can  be  conveyed  as: 

X=  ,  S  =  (4.13) 

y  (— )2 

dp 


Where  s  is  the  step  size  which  denotes  the  span 
of  each  gradient  shift  in  the  parameter  space. 
The  value  of  s  can  be  improved  to  vary  speed 
of  convergence. 

5.  SIMULATION  STUDIESOF3D 
NAVIGATION 

During  path  planning,  the 
instantaneous  information  can  be  acquired  by 
the  underwater  robot  sensors.  Steering  angle 
towards  the  position  to  be  reached  from  the 
current  position  of  the  underwater  robot  can  be 
computed  using  ANFIS  toolbox  whose  dataset 
(for  training  and  testing  puipose)  has  already 
been  collected  from  experimental 
investigations.  In  present  investigation, 
maximum  no.  of  iterations  for  ANFIS  training 
has  been  set  as  200  (epochs)  and  the  error  has 
got  to  be  asymptotic.  The  training  RMS  error 
was  found  to  be  0.0156  as  shown  in  figure 
A4.The  scatter  plot  of  FIS  output  versus 
training  dataset  and  testing  dataset  are 
displayed  in  figure  A5and  figure  A6separately. 
It  was  also  found  that  the  predicted  values  of 
steering  angle  are  nearer  to  the  actual  values. 
Simulated  studies  on  path  planning  in  3D 
environment  have  been  shown  for  endorsing 
proposed  method.  When  the  values  from  any 
sensors  are  slightly  less  than  the  threshold 
values  (35mm),  obstacle  avoidance  behaviour 
has  to  be  initiated.  Collision  avoidance  has  the 
highest  priority  as  shown  in  figure  A7.  When 
the  mobile  robot  senses  both  target  and 
obstacle  in  same  direction,  the  wall  following 
behaviour  would  be  executed  to  avoid  local 
minima. 

The  robot  must  turn  clockwise  or 
anticlockwise  such  that  it  can  make  parallel 
movement  along  the  wall  as  shown  in  figure 
A8.  Preliminary  robotic  behaviours  have  been 
conquered  here  through  a  number  of  training 
patterns  of  ANFIS. 
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6.  CONCLUSION 

The  learning  mechanism  of 
implemented  algorithm  allows  AUV  to  adopt 
knowledge  on  behaviour  by  cooperating  with 
the  environment.  The  inadequacy  in 
knowledge  due  to  uncertainty  and  nonlinearity 
can  be  disregarded  by  employing  the  rule-base 
of  ANFIS  which  can  reflect  fusion  of  all 
robotic  behaviours.  AUV  motion  can  be 
controlled  in  both  vertical  plane  and  horizontal 
plane.  Using  ANFIS  tool  box,  the  obtained 
mean  of  squared  error  (MSE)  for  training  data 
set  in  the  current  paper  is  0.0156.The  obtained 
results  from  the  above  model  was  analysed  in  a 
number  of  simulated  experiments  using 
MATLAB  and  it  validates  the  feasibility  of  the 
proposed  method.  The  hybrid  learning  based 
ANFIS  may  have  shown  optimal  effect  to 
some  extent  by  using  updated  information 
about  the  target  and  obstacles  concurrently,  but 
the  gained  path  may  not  be  globally  optimal. 
Simulation  results  show  the  success  of 
algorithm  as  robot  moves  smoothly  towards  its 
target  avoiding  collision.  Further  studies  with 
experimental  verification  of  simulated  results 
will  be  performed  using  proposed  method. 
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APPENDIX  A 


Front  Sensor  o/p 


Left  Sensor  o/p 


Left  Horizontal 
Thruster's  Speed 


Difference 
method 
applied  on 
Speed  of 
Thrusters 


Heading  Angle 


Final  Steering 
Angle  towards 


FigureAl.BlockdiagramofmultipleANFISmodelsforunderwatermobilerobotnavigation. 
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Xi.Xi.jr,,^  and 
consequent  paratneters 


Figure  A3.  ANFIS  architecture  of  six  layers 
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Training  data :  o  FIS  output:* 


Index 


Figure  A5.  Scatter  of  FIS  output  and  training  data 


Testing  data : .  FIS  output:* 


Index 


Figure  A6. Scatter  of  FIS  output  and  testing  data 
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l)V  Robot 


Figure  A7. Static  obstacle  avoidance  behaviour 


Figure  A8. Navigational  path  traced  based  on  obstacle  avoidance  and  target  seeking  behaviour 
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